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1.) Introduction 
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The current state : 

-In the old days: analogue signal processing 
-PC has revolutionized the domain of audio engim 
-HD recording / editing / mastering 
-prof, software e.g.: Ardour, Cubase, ProTools etc 
-MP3, Ogg Vorbis Files -> sharing / exchange 



Old StuderTape 
Machine 


Real musical interplay ? 


1) Introduction 
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2) Theory of remote musical 
interaction 
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-jjj 
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Room 1 


Room 2 


• Cognitive Science: Integration Processes 

• Ira J. Hirsh : Threshold for order identification = 20 ms 

• Slightly higher for interactive music : Schuett/Chafe EPT = 30 ms 


2) Theory 
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rhythm section constellation 
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2) Theory 
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personal beat shift range (PBSR) 


external pulse 

I 


interpulse delay 



beat proximity 
close 


PBSR 


EDAL (Ensemble Delay Acceptance Threshold) 


2) Theory 
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2) Theory 
















Universitat zu Lubeck / Institut fur Telematik 



2) Theory 


Realistic Interaction Approach (RIA) 
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2) Theory 


Speed of sound : 343 m/s 
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~ 8,5 m 


2) Theory 
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significant delay 
slight delay 
no delay 


speed of light: 300.000 km/s (factor ~ 900.000 !) 

2) Tneory 
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2) Theory 
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2) Theory 
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2) Theory 
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2) Theory 
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3.) Alternative Approaches 
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player 1 


player 2 





Strings Aparb£) 

Pedro Rebelo, Mark Applebaum 
SARC / CCRMA (8141 km / ~ 100 ms) 


delay >> 2 5 ms 




Latency Accepting Approach (LAA) 


3) Alternative Approaches 
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Bass-Master-Groove 




Master/Slave Approach (MSA) 


3) Alternative Approaches 
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master 


slave 


© 

Alexander Carot / Nicolas Durand 
Lubeck / Paris (~ 751 km / 35 ms ) 


50 ms > delay > 25 ms 

- > 


Laid-Back Approach (LBA) 


3) Alternative Approaches 
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delay > 25 ms 


Single delayed feedback (SDF) 

slave 


Alexander Carot / Michael Stahl 
Lubeck-DSL / Erlangen (-520 km / 
ms) 



feedback (DD 


Delayed Feedback Approach (DFA) 


3) Alternative Approaches 
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•EDAL = 0 ms (!) 

•Approach: Application of SDF (single delayed feedback) 


Headphones 


OWD 


4) Netjack 
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4.) Interconnection of remote 
electronic 

sequencers (Netjack) 
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History of Netjackl 

• Implemented as a patch to jack in 2005. 

• Committed to jack-svn 2008-03-06 

• In November 2009 I got aware of CELT and 
added support for that. 

• Then started making netjack more robust 
against packet loss. 

• Reimplemented the algorithm used in alsa_io 


Universitat zu Lubeck / Institut fur Telematik 

Synchronise jack-transport 

• No vari-speed in jack. 

• Only possibility is synchronising sample-clock 

• Thats the idea behind netjack. 

• Jack-driver which syncs one instance of jackd 
to another one. 
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Computer 1 (Master) 



4) Netjack 


Computer 2 (Slave) 
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Codecs 

• Mainly 2 types of codecs. 

- High delay (mp3, vorbis, aac) 

• Need > 100ms of audio to emit a compressed byte. 

• Suitable for music. 

- Speech Codecs 

• Speex, gsm.... 

• Low latency 

• Not suitable for music. 

• Need low-latency music codec 
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CELT 


• Closes gap between vorbis and speex. 

• xiph.org (BSD style) 

• Nice music quality. 

• Support for Packet Loss Concealment 

• Many different latencies, and bitrates 
supported. 
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Low-latency Codec comparison 
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Bit rate reduced, go internet ? 

• With the reduced required bitrate it is 
theoretically possible, to create a netjack link 
over internet. 

• OHNOES. where iz packet ? 

• A packet may either be late or get lost on the 
internet. 

• Netjack was ignoring this fact, because it doesnt 
happen on LAN. 
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How to decide if packet is lost ? 


• Easy on the master. It expects a packet with a 
specific sequence number in 
process_callback(). 

• On the slave i am using a deadline, which is 
constantly calibrated. So that a „reply“ to lost 
packet is still reaching the master in time. 
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so... netjackl scales now. 


• Zero latency mode. 

• 1-3 periods of Roundtrip on LAN 

• Arbitrary latency for an internet link. 
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Why not Netjack2 ? 

• „Jackl is dead, stop hacking it.“ © sampo_v2 

• Netjack2 was written while i was pretty 
inactive. No backport to jack 1 was done. 

• Its more comfortable, but purely targeted at 
LAN. (broadcast) 

• Adding CELT support to netjackl took 1 hour. 
It was my code. 

• The packet assembly code needed only small 
mod, to become a jitter-buffer. 
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Both protocols waste bandwidth 


• Netjackl has a huge packet header 

- 48 bytes per packet, (most of it has redundant data) 

• Netjack2 uses a second sync packet. 

- Also a lot of overhead when encapsulated. 

• so... i think, we want netjack3. 
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Conclusion 


•We can use netjack over Internet. 

• Needs a nice frontend to setup connections. 

•We have a big mess with 2 implementations of 
jack and 2 implementations of netjack. 

• It looks like the mess will get bigger (netjack 1 
for jack2 is in the pipe) 

• Hopefully netjack3 will not make it even worse. 


